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VOCATIONAL  INTEREST-CAREER  EXAMINATION: 

NORMING  AND  STANDARDIZATION  ON  A 
NATIONWIDE  HIGH  SCHOOL  SAMPLE 

I . INTRODUCTION 

The  Air  Force  Vocational  Interest-Career  Examination  (VOICE) 
was  developed  to  enhance  the  assessment  process  relating  to  job  assign 
ment  In  the  Air  Force.  The  Initial  efforts  to  construct  this  Instru- 
ment were  performed  under  contract  with  the  Educational  Testing 

Service  (Echternacht,  Reilly,  and  McCaffrey,  1973).  The  VOICE  was 
further  developed  by  grouping  Item  responses  Into  18  homogeneous 
subscales  (Alley,  Berberlch,  and  Wllbourn,  1976).  In  addition  to 
Its  use  within  the  Air  Force,  Its  utility  in  the  joint  services  high 
school  testing  program  has  also  been  considered.  A study,  relating 
the  VOICE  to  reported  job  satisfaction,  found  moderate  but  highly 
consistent  relationships  between  VOICE  scale  scores  and  job  satis- 
faction data  collected  approximately  one  year  later  (Alley,  Wllbourn, 
and  Berberlch,  1976).  These  results  support  the  case  for  using  VOICE 
as  an  adjunct  to  the  standardized  aptitude  assessment  program.  The 
report  that  follows  describes  a project  undertaken  to  Implement  one 
of  the  recommendations  In  the  1976  study:  to  norm  and  standardize 
the  Interest  composites. 

The  overall  purpose  of  the  present  stucly  was  to  standardize  the 
Air  Force  vocational  Interest  Inventory,  the  VOICE,  on  a nationwide 
high  school  sample  of  10th,  11th,  and  12th  graders  so  that  the  VOICE 
might  be  calibrated  with  respect  to  the  total  Air  Force  applicant 
pool.  A specific  purpose  of  the  stucty  was  to  develop  separate  norms 
for  subsamples  Identified  by  school  grade,  sex,  ethnic  background 
and  geographic  area.  Three  major  tasks  were  Involved:  sample 
construction,  VOICE  administration,  and  data  analysis. 


II.  APPROACH 


Sampling  Design 

A major  consideration  In  the  multistage  cluster  sampling  plan 
designed  for  this  study  was  geographic  area  norms.  To  preclude  an 
unrealistic  multiplicity  of  sampling  cells,  the  nine  U.S.  Continental 
census  regions  were  combined  Into  five.  Table  1 lists  the  states 
In  these  regions.  The  first  stage  In  the  sampling  was  to  select 
clusters  of  schools  within  regions  that  were  approximately  propor- 
tionate to  the  numbers  of  urban  and  rural  public  and  private  high 
schools  In  each  and  to  size  of  enrollment.  The  Intent  of  the  second 
stage  was  to  select  randomly  equal  numbers  of  Black  and  non-Black  male 
and  female  students  within  each  grade  level:  10,  11  and  12. 

Schools.  The  stratification  variables  of  region,  population 
density,  type  of  control,  and  enrollment  size  were  designed  to  obtain 
a sample  of  schools  approximately  proportionate  to  the  actual  number 
of  U.S.  high  schools  In  each  of  the  resulting  cells.  The  variables 
were  stratified  as  follows: 

Regions:  Northeast,  Southeast,  Central,  Mountain  West,  and 
Pacific  West 

Population  Density:  Urban;  Rural 

Type  of  Control:  Public;  Private 

Enrollment  Size  1 : 300  to  2,000;  over  2,000 

A strong  consideration  In  the  sampling  plan  was  the  likelihood  of 
obtaining  a sufficient  number  of  Black  students.  Originally,  equal 
numbers  of  Black  and  non-Black  students  In  the  sample  were  envisioned, 
rather  than  proportional  numbers.  To  achieve  even  a proportionate 
representation  of  Blacks,  however.  It  was  necessary  to  design  a plan 
that  would  maximize  the  probability  of  their  selection.  The  racial 
composition  of  secondary  schools  Is  not  available  on  computer  tape 
sampling  data  bases,  so  the  following  strategy  was  employed  In 
selecting  schools.  First,  the  regional  strata  of  the  sample  were 

^The  enrollment  size  constraints  were  for  public  schools  only. 
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Table  1.  Distribution  of  States  In  Five  Regions 


Pacific  West 

Central 

Northeast 

Washington 

North  Dakota 

New  York 

Oregon 

South  Dakota 

Pennsylvania 

California 

Nebraska 

Maine 

Kansas 

New  Hampshire 

Mountain  West 

Oklahoma 

Vermont 

Texas 

Massachusetts 

Idaho 

Mississippi 

Connecticut 

Montana 

Minnesota 

Rhode  Island 

Nevada 

Iowa 

New  Jersey 

Utah 

Missouri 

Colorado 

Arkansas 

Southeast 

Arizona 

Louisiana 

New  Mexico 

Kentucky 

Delaware 

Wyoming 

Alabama 

Maryland 

Wisconsin 

Virginia 

Illinois 

West  Virginia 

Michigan 

North  Carolina 

Indiana 

South  Carolina 

Ohio 

Georgia 

Tennessee 

Florida 

adjusted  to  emphasize  those  regions  that  have  a higher  proportion  of 
Black  students.  The  target  number  of  schools  from  each  region  paral- 
leled approximately  the  relative  concentrations  of  Black  students. 

The  second  feature  of  the  strategy  required  that  within  each 
region  50  percent  of  the  schools  would  be  selected  from  the  five  largest 
cities.  With  50  percent  coming  from  metropolitan  areas  the  likelihood 
was  Increased  that  Black  students  would  be  selected  for  the  sample. 

The  third  feature  concerned  size  of  school  enrollment.  All  schools 
selected  were  limited  to  those  with  300  or  more  students  (the  same 
criterion  employed  by  the  Health  Education  and  Welfare  Office  of  Civil 
Rights).  This  limitation  would  result  In  a higher  probability  of 
selecting  schools  In  more  densely  populated  areas,  where  minority  groups 
tend  to  be  concentrated.  An  effect  of  limiting  public  school  size  In 
this  way  is  to  leave  approximately  10  percent  of  rural  schools  out  of 
the  rural  school  sampling  frame.  However,  the  representation  In  terms 
of  number  of  rural  students  from  this  size  school  Is  quite  small,  and 
the  consideration  of  obtaining  a sufficient  number  of  Black  students 
overrode  the  effect  of  underrepresenting  the  smaller  schools. 

Students.  The  selection  of  students  was  designed  to  obtain  a total 
sample  size  of  12,000  with  approximately  equal  numbers  In  each  sub- 
sample. School  officials  were  asked  to  select  randomly  33  male  and  33 
female  students  from  each  of  the  three  grade  enrollment  lists,  a total 
of  198  students  per  school.  (If  a private  school  had  an  anrollment  of 
fewer  than  200  students,  the  total  enrollment  was  requested  for  the 
sample.)  Ethnic  grouping;  l.e.,  Black/non-Black,  was  to  be  a classifi- 
cation variable  after  the  sampling  had  been  guided  directly  by  the 
strata  mentioned  above. 

Sources  of  Information.  A printout  listing  all  public  schools 
In  the  U.S.  which  offer  at  least  10th,  11th  and  12th  grade  classes  was 
used  as  the  sampling  base.  Enrollment  sizes  were  given,  which  per- 
mitted dividing  the  base  Into  small  schools  (300—2,000  students)  and 
large  (over  2,000).  A Rand  McNally  atlas  was  used  to  determine  whether 


a school  was  rural  or  urban,  using  the  U.S.  Bureau  of  the  Census  defi- 
nition of  rural:  communities  with  populations  less  than  2,500  and  at 
least  50  miles  from  an  urban  location. 

The  Digest  of  Educational  Statistics  (Grant  & Line,  1974)  was 
used  to  find  the  number  of  public  and  private  high  schools  In  the  con- 
tinental U.S.  Information  on  private  schools  was  obtained  from  the 
County  and  City  Date  Book  (Department  of  Commerce,  1972).  The  popu- 
lation of  10th,  11th  and  12th  graders  In  each  U.S.  region  was  derived 
from  age  data  In  the  1970  Census  of  Population. 

The  data  gathered  on  numbers  of  public  and  private  schools,  urban 
and  rural  schools,  students  at  each  grade  level,  and  school  size  pro- 
vided the  base  for  school  selection  within  each  region.  Ratios  were 
computed  so  that  each  of  these  variables  was  represented  proportionately 
to  their  base,  with  the  exceptions  noted  above.  To  compensate  for  re- 
fusals to  participate,  more  than  three  times  as  many  schools  were 
selected  as  were  required  for  the  sample. 

Arrangements  for  Participation 

The  best  laid  plans  of  sampling  designers  can  only  be  Implemented 
If  the  sample  selected  agrees  to  cooperate.  To  achieve  the  desired 
rate  of  participation  and  quality  of  response, attempts  were  made  to 
develop  positive  Interactions  between  the  researchers  and  the  officials 
of  the  selected  schools.  These  Included: 

1.  A detailed  letter  of  Introduction  and  Invitation  to  partici- 
pate emphasizing  student  anonymity  and  offering  feedback  to 
the  students  In  the  form  of  Individual  Interest  profiles. 
Response  forms  and  addressed  envelopes  with  return  postage 
were  enclosed. 

2.  If  the  school  principal  Indicated  that  clearance  had  to  be 
obtained  from  a state  or  local  educational  research  department. 
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a package  containing  the  Introductory  letter,  e set  of 
sampling  and  administration  Instructions,  and  a copy  of 
VOICE  were  sent  to  the  appropriate  agency  for  approval. 

3.  Follow-up  letters  and  phone  calls  were  made  to  all  those 
who  did  not  return  response  forms. 

4.  Letters  were  sent  to  a second  sample  drawn  from  areas 
where  Insufficient  agreements  were  obtained. 

5.  Follow-up  calls  were  made  to  participating  school  officials 
to  arrange  for  the  details  of  the  test  administration.  At 
this  time  options  were  offered  with  respect  to  ways  of 
conducting  the  VOICE  administration:  a representative  of 
Psychometrics  or  a member  of  the  school  staff.  If  the 
latter,  the  school  would  be  n*1d  a minimum  of  $75.00  for 
sampling  the  students  and  administering  VOICE.  Advance 
copies  of  the  sampling  and  administration  Instructions 
were  sent  to  Indicate  the  extent  of  the  task. 

6.  Materials  were  sent  to  the  schools  doing  their  own  admin- 
istration. These  Included  detailed  Instructions;  VOICE 
questionnaires;  answer  sheets;  student  Identification  con- 
trol sheets;  mailing  labels  for  return  of  answer  sheets  to 
Air  Force  Human  Resources  Laboratory  for  entry  onto  tapes  and 
return  of  control  sheets  to  Psychometrics;  and  return  postage. 

7.  If  materials  were  not  returned  within  three  weeks  after  they 
were  due,  a phone  call  was  made  to  the  contact  person  at  the 
school  In  question  to  see  If  there  was  a problem  that  could 
be  resolved. 

Every  effort  was  made  to  dissipate  anxieties  concerning  the 
uses  to  which  test  results  would  be  put.  To  provide  support  and 
encouragement  for  the  study  personal  contact  was  made  with  minority 
civic  groups  (In  locations  where  they  could  help)  who  were  interested 
in  advancing  job-related  research  Involving  their  communities. 
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Data  Analysis 

The  statistical  analysis  Involved  data  editing  and  scoring  as 
preliminary  steps.  The  VOICE  Op  Scan  answer  sheets  were  read  directly 
by  machine  and  the  responses  were  recorded  In  Input  order  on  magnetic 
tape  at  AFHRL  facilities.  Considerable  editing  of  the  answer  sheets 
was  necessary  to  detect  errors  and  salvage  tests  that  were  filled  In 
with  pen  or  were  otherwise  unscannable.  The  computer  scoring  of  the 
VOICE  scales  provided  additional  checking  and  error  detection.  The 
control  sheets  containing  participating  students'  Identification 
numbers  (which  was  a code  for  region  and  school,  as  well),  sex,  grade, 
and  ethnic  background  provided  a means  of  checking  the  accuracy  of  the 
assignment  of  answer  sheets  to  their  proper  categories  for  norming. 

Test  data  were  not  entered  into  the  data  base  until  errors  were 
resolved. 

Statistics.  VOICE  scale  score  means  and  standard  deviations 
were  computed  for  60  subsamples:  five  regions,  three  grades,  two 
sexes,  and  two  ethnic  categories.  The  differences  between  means  were 
tested  for  significance  by  the  t statistic.  Norms  (T-scores)  were 
planned  for  groups  with  sample  sizes  of  at  least  100.  The  population 
size,  respective  to  each  subsample  was  determined  from  census  data  to 
weight  means  and  norms,  where  appropriate. 

The  computation  of  descriptive  statistics  Involved  the  weighting 
of  subsamples  relative  to  their  populations  prior  to  any  summary  or 
combination  of  data.  An  estimate  of  the  actual  population  in  each 
cell  was  obtained  from  the  most  recent  census  data  (1970).  The  total 
population  has  Increased,  but  probably  no  unusual  regional  shifts  have 
occurred.  The  census  figures  are  given  for  secondary  schools  by  state 
for  ethnic  and  male-female  groups,  making  It  possible  to  derive 
regional  statistics  for  Black  and  non-Black  males  and  females.  Second- 
ary school  populations  are  not  broken  down  by  grade,  however;  so 
estimates  were  made  of  the  percents  In  grades  10,  11  and  12  based  on 
the  assumption  of  declining  enrollment.  For  example,  the  population 


7 


of  males  In  4-year  high  schools  were  summed  across  the  states  within 
a region.  Ninth  graders  (not  studied  In  this  project)  were  assumed 
to  account  for  281  of  the  whole;  10th~26X,  11th— 24X,  and  12th— 22X. 
The  basis  for  this  assumption  was  the  relative  proportion  of  students 
In  each  grade  reported  by  the  85  school  principals  and  counselors  In 
the  selected  sample. 

The  closest  estimate  of  the  number  of  Blacks  and  other  races 
for  each  sex  at  each  grade  level  was  the  proportion  of  Blacks  to 
other  races  In  the  total  population  for  that  state  or  region.  The 
estimated  population  per  cell  and  the  actual  sample  for  each  cell  Is 
reported  In  Table  2.  The  total  number  of  students  completing  scorable 
VOICE  answer  sheets  was  12,146,  or  .1  percent  (rounded)  of  the  national 
population  of  students  In  grades  10  to  12  (10,347,000).  To  compute 
national  group  means,  then,  the  obtained  number  In  each  cell  was 
weighted  by  the  ratio  of  one- thousandth  of  the  population  for  that 
group  to  the  obtained  number  (^jp*/n).  Similarly,  the  population 
was  used  In  combining  variances  over  cells  for  reporting  standard 
deviations. 

Norms.  Normative  statistics  were  computed  for  each  of  the  13 
VOICE  scales.  The  means  and  standard  deviations  were  adjusted  by  the 
ratio  of  population  to  obtained  sample  numbers  for  each  cell.  The 
normative  Information  Is  available  as  a separate  document  from  AFHRL. 

III.  RESULTS 


The  Sample 

Schools.  Agreements  were  received  from  85  schools,  but  the 
testing  program  was  completed  by  68.  (Reasons  offered  by  the  non- 
respondents are  given  In  the  Discussion  section.)  The  distribution 
of  schools  across  strata  of  Interest  may  be  seen  In  Table  3. 
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Table  3.  Number  of  Schools  by  Stratification  Variable 


School 

Type 

School 

Size 

Northeast 

Southeast 

Central 

Mountain 

Pacific 

National 

Total 

URBAN 

Public 

Large 

1 

5 

2 

2 

1 

11 

Public 

Small 

3 

5 

11 

6 

6 

31 

Private 

(NA) 

2 

1 

2 

1 

1 

7 

RURAL 

Public 

Large 

• 

- 

• 

• 

- 

0 

Public 

Small 

3 

2 

11 

2 

1 

19 

Total 

9 

13 

26 

11 

9 

68 

Students . The  number  of  students  who  provided  scorable  VOICE 
tests  In  each  national  and  regional  category  of  Interest  Is  shown  In 
Tables  4,  5,  and  6.  It  was  clear  from  Table  2 that  certain  cells  In 
the  original  grade  x sex  x race  x region  breakdown  were  Insufficiently 
sampled  to  compute  reliable  norms.  The  various  sets  of  marginals, 
however,  were  very  well  represented  (Tables  4 through  6). 

Table  4 presents  male  and  female  sample-to-populatlon  ratios 
across  regions.  In  absolute  numbers  the  best  represented  region  Is 
the  Mountain  West  as  a result  of  oversampling  to  compensate  for  Its 
having  the  smallest  population.  The  poorest  representation  was  for 
the  populous  Northeast  region,  where  severe  economic  constraints 
operated  to  preclude  the  "luxury"  of  participation  In  research 
projects.  There  were  slightly  more  males  than  females  In  the  total 
sample,  but  this  difference  was  not  a consistent  trend  across  regions. 

Table  4.  Region  by  Male/Female:  Samples  and  Respective  Populations9 


Northeast 

Southeast 

Central 

Mountain 

Pacific 

National 

Total 

Male  n 

N 

841 

1,180.6 

995 

719.6 

2,327 

2,251.1 

1,034 

230.2 

893 

656.7 

6,090 

5,038.2 

Female  n 

N 

798 

1,276.5 

985 

750.8 

2,338 

2,369.9 

1,028 

234.5 

907 

676.9 

6,056 

5,308.6 

an  - obtained  number  tested. 

N ■ population  In  thousands. 


Table  5 presents  a grade  by  sex  breakdown  of  the  sample  across 
regions.  The  national  census  shows  an  eight  percent  decrement  In 
student  enrollment  between  Grades  10  and  11  and  between  Grades  11  and 
12  for  both  males  and  females.  The  percent  of  decrease  In  the  tested 
sample  between  grades  Is  less  than  that  for  the  population.  The  male 
sample  showed  decreases  of  five  percent  from  Grade  10  to  Grade  11,  and 
four  percent  from  11  to  12.  The  female  sample  showed  a decrease  of 
five  percent  from  Grade  10  to  Grade  11,  and  virtually  no  decrease 
between  Grades  11  and  12. 


Table  5.  Region  by  Grade  by  Hale/Female 

Samples  and  Respective  Populations* 


Northeast 

Southeast 

Central 

Mountain 

Pacific 

National 

Total 

GRADE  10 

Male  n 

287 

315 

871 

350 

310 

2133 

N 

435.5 

260.0 

812.3 

83.3 

236.9 

1828.0 

Female  n 

284 

334 

817 

357 

298 

2090 

N 

461.1 

271.2 

855.1 

84.9 

244.1 

1916.4 

GRADE  11 

Male  n 

304 

350 

719 

342 

306 

2021 

N 

393.6 

239.3 

751.8 

76.7 

219.3 

1680.7 

Female  n 

229 

331 

787 

325 

314 

1986 

N 

425.5 

249.7 

791.5 

78.1 

226.1 

1770.9 

GRADE  12 

Male  n 

250 

330 

737 

342 

277 

1936 

N 

360.5 

220.3 

687.0 

70.2 

200.5 

1538.5 

Female  n 

285 

320 

734 

346 

295 

1980 

N 

389.9 

229.9 

723.3 

71.5 

206.7 

1621.3 

*n  « obtained  number  tested. 

N ■ population  In  thousands. 


Table  6 gives  a grade  by  ethnicity  by  sex  breakdown  of  the  sample 
with  the  regions  collapsed.  The  Black  representation  In  this  classifi- 
cation system  Is  sufficient  to  compute  reliable  descriptive  statistics. 
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Table  6.  Male/Female  by  Ethnicity  by  Grade:  National  Totals 


Sex: 

Ethnicity: 

Male 

Female 

Black 

Other 

Black 

Other 

Grade  10  n 

373 

1,760 

331 

1,759 

N 

192.9 

1,626.1 

212.1 

1,704.3 

Grade  11  n 

300 

1,721 

315 

1,671 

N 

178.1 

1,502.6 

196.0 

1,574.9 

Grade  12  n 

292 

1,644 

306 

1,674 

N 

163.1 

1,375.4 

179.6 

1,441.7 

Total  n 

965 

5,125 

952 

5,104 

N 

534.1 

4,504.1 

587.7 

4,720.9 

an  * obtained  number  tested. 

N * population  In  thousands. 


Table  7.  Reference  Groups  for  the  Tabularized  Normative  Data 


Table  8: 
Table  9: 


Subscales  for  the  Vocational  Interest-Career  Examination 
Means  and  Standard  Deviations  by  Sex 

Subscales  for  the  Vocational  Interest-Career  Examination 
Means  and  Standard  Deviations  by  Grade  by  Sex 


Table  10:  Subscales  for  the  Vocational  Interest- Career  Examination 
Means  and  Standard  Deviations  by  Region  by  Sex 

Table  11:  Subscales  for  the  Vocational  Interest-Career  Examination 
Means  and  Standard  Deviations  by  Region  by  Grade  by  Sex 

Table  12:  Subscales  for  the  Vocational  Interest-Career  Examination 
Means  and  Standard  Deviations  by  Race  by  Sex 

Table  13:  Subscales  for  the  Vocational  Interest-Career  Examination 
Means  and  Standard  Deviations  by  Grade  by  Sex  by  Race 


Distribution  Characteristics 

Means  and  standard  deviations  are  given  In  Tables  8 through  13  for 
each  of  the  18  VOICE  scales  for  the  groups  described  In  Table  7. 
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TABLE  9.  SUBSCALES  FOR  THE  VOCATIONAL  INTEREST-CAREER  EXAMINATION 
MEANS  ANO  STANOARO  DEVIATIONS  BY  GRADE  BY  SEX  (continued) 
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TABLE  10.  SUBSCALES  FUR  THE.  VOCATIONAL  INTEREST-CAREER  EXAMINATION 
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TABLE  11.  subscales  for  the  vocational  interest-career  examination 
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TABLE  13.  SUBSCALES  FOR  THE  VOCATIONAL  INTEREST— CARE  01  EXAMINATION 
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TABLE  13.  SUdSCALES  FOR  THE  VOCATIONAL  INTER ESI -CARE  EH  EXAMINATION 

MEANS  AND  STANOARO  DEVIATIONS  HY  GRADE  BY  SEX  dV  RACE  (continued) 
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Male/Female.  Table  8 Indicates  that  male  students  tend  to  report 
greater  Interest  than  do  females  on  the  Electronics,  Heavy  Construction, 
Science,  Mechanics,  Law  Enforcement,  and  Marksman  scales  of  the  VOICE. 
Female  students  have  higher  mean  scores  on  the  Office  Administration, 
Medical  Service,  Aesthetics,  Food  Service,  Audiographics,  Agriculture, 
Teacher/Counseling,  and  Craftsman  scales.  The  two  groups  have  approx- 
imately equal  means  on  the  Outdoors,  Math,  Drafting,  and  Data  Process- 
ing scales.  These  outcomes  seem  quite  predictable.  In  fact,  these 
patterns  of  Interest  parallel  those  found  in  the  job  satisfaction 
study  (Alley,  et  al.,  1976),  with  one  exception.  The  sample  In  the 
present  study  showed  males  to  have  a somewhat  higher  expressed  Interest 
In  Science  than  did  females,  whereas  the  previous  study  found  equiva- 
lent Interest  for  the  two  groups.  For  the  most  part,  the  previous 
study,  based  on  the  data  of  22,745  male  and  female  Air  Force  recruits, 
obtained  mean  scale  scores  and  standard  deviations  that  were  slightly 
higher  than  those  of  the  present  national  sample  of  high  school 
students. 

Grade  by  Sex.  Table  9 indicates  that  male  students  tend  to 
express  slight  Increases  In  Interest,  In  most  vocations,  as  a group, 
as  their  grade  level  Increases.  The  only  exception  to  this  Is  with 
respect  to  the  Marksman  scale,  where  male  Interest  seems  quite  stable 
over  the  grades.  Interest  In  the  vocational  scales  tends  to  increase 
with  time  for  the  female  students  also,  but  a stabilizing  of  Interest 
seems  to  occur  earlier  for  them.  In  that  there  Is  virtually  no 
change  after  the  11th  grade  for  8 of  the  VOICE  scales. 

Region  by  Sex.  Regional  differences  In  the  expressed  Interests 
of  male  students  are  very  slight  (Table  10).  Males  In  the  Pacific  West 
region  tend  to  have  the  lowest  mean  scores,  and  the  Southeast  and 
Mountain  region  males  tend  to  have  the  highest.  Because  of  large 
sample  sizes,  a small  difference  between  means  can  be  statistically 
significant.  For  example,  small  but  significant  differences  between 
the  Mountain  and  Pacific  regional  means  for  males  were  found  for  the 
Heavy  Construction,  Outdoors,  Agriculture,  and  Marksman  scales. 
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Similarly,  Southeastern  female  students  differed  from  their  Pacific 
Uest  counterparts  In  showing  slightly,  but  significantly  more  Interest 
In  Office  Administration,  Medical  Service,  Teacher/Counseling  and  ADP. 

A number  of  other  small  mean  scale  score  differences  are  significant 
between  pairs  of  regions,  but  few  dramatically  so.1 

Region  by  Grade  by  Sex.  A comaprison  of  mean  scores  across 
regions  for  tenth  grade  males  Indicates  a tendency  for  the  highest 
Interests  to  be  expressed  In  the  Mountain  region,  and  the  lowest  in  the 
Pacific  region  (Table  11).  This  pattern  changes  for  eleventh  grade 
males,  who  show  the  highest  Interests,  on  the  whole,  for  those  who  come 
from  the  Southeast,  and  the  lowest  Interests  for  those  from  the  Central 
region.  Differences  among  regions  are  very  small  for  twelfth  grade 
males,  and  no  systematic  pattern  emerges.  In  all  cases  the  trends 
Indicated  above  refer  to  differences  between  mean  scores  that  are  too 
small  to  be  practical. 

The  data  for  female  students  are  somewhat  more  stable  across 
grades  In  that  the  Pacific  West  region  tends  to  yield  the  lowest  mean 
scale  scores  at  all  grade  levels.  The  higher  expressed  Interests,  how- 
ever, change  geographically  with  grade:  the  highest  tenth  grade  means 
are  seen  for  the  Southeast  and  the  Mountain  West;  the  highest  eleventh 
grade  means  tend  to  show  up  In  the  Northeast;  and  the  highest  twelfth 
grade  means  are  dispersed  over  the  Northeast,  Southeast,  and  Mountain 
West.  Again,  the  regional  differences  In  vocational  Interest  across 
grades  are  too  small  to  be  of  practical  value. 

Race  by  Sex.  Both  the  Black  male  and  female  groups  tend  to  show 
significantly  higher  mean  scores  on  most  of  the  VOICE  scales  than  do 
the  non-Black  groups  (Tables  12  and  14).  This  Is  especially  true  for 
the  Office  Administration,  Electronics,  Mathematics,  Teacher/Counseling, 
Craftsman,  and  Data  Processing  Scales.  Non-Blacks  tend  to  report  higher 
Interest  on  the  Outdoors,  Agriculture,  and  Marksman  scales.  Although 
most  of  the  t-test  results  on  which  these  observations  are  based  are 

1 Regional  t-test  results  are  not  tabulated  In  this  report. 
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Table  14.  SELECTED  t - RATIO  RESULTS 
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highly  significant,  an  examination  of  the  means  In  Table  12  shows  the 
actual  mean  score  differences  between  Blacks  and  non-Blacks  to  range 
from  one-tenth  of  a point  (Marksman,  female  data)  to  5.8  points  (Agri- 
culture, female,  non-Blacks  higher).  The  largest  difference  between 
the  mean  score  of  male  Blacks  and  non-Blacks  was  for  Office  Adminis- 
tration (5.2  points,  Blacks  higher).  Since  the  Agriculture  scale  has 
only  30  Items,  the  5.8  point  difference  Is  more  dramatic  than  the 
result  for  the  40-Item  Office  Administration  scale. 

Table  12  compares  Interests  between  Black  and  non-Black  male  and 
female  students.  Black  males  Indicate  more  Interest  as  a group  (have 
higher  mean  scores)  than  do  the  non-Black  males  on  the  Office  Admin- 
istration, Electronics,  Science,  Medical  Service,  Aesthetics,  Food 
Service,  Audiographics,  Mathematics,  Teacher  Counseling,  Craftsman, 
Drafting,  and  Data  Processing  scales.  Non-Black  males  have  higher 
mean  scores  on  the  Heavy  Construction,  Outdoors,  Agriculture,  Marksman, 
Mechanics,  and  Law  Enforcement  scales. 

Black  females  have  higher  mean  scores  than  do  non-Black  females 
on  the  Office  Administration,  Electronics,  Heavy  Construction,  Science, 
Mechanics,  Mathematics,  Teacher/Counseling,  Craftsman,  Drafting,  and 
Data  Processing  scales.  Non-Black  females  have  higher  mean  scores  on 
the  Outdoors,  Law  Enforcement,  Audiographics,  and  Agriculture  scales. 
Means  were  virtually  the  same  for  the  two  groups  on  Marksman,  Medical 
Service,  Aesthetics  and  Food  Service  scales. 

Grade  by  Sex  by  Race.  The  pattern  of  Black  vs.  non-Black 
differences  In  vocational  Interests  shows  virtually  no  change  across 
grades  (Table  13).  Interests  tend  to  Increase  within  each  racial 
group,  but  the  direction  of  between-group  differences  Is  generally 
maintained  throughout  high  school.  Although  the  direction  of  the 
differences  between  the  mean  scores  of  Black  and  non-Black  females 
persisted  across  grades,  the  sizes  of  these  differences  tended  to 
diminish  more  than  they  did  for  males  as  grade  level  rose. 
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IV.  DISCUSSION  AND  RECOMMENDATIONS 


Group  Norms  and  Group  Differences 

Vocational  Interest  data  for  minority  groups  has  been  almost 
non-existent.  It  was  the  Intention  of  AFHRL  In  sponsoring  this  study 
to  remedy  this  lack  with  respect  to  Black  students.  In  addition  to 
establishing  regional  male  and  female  norms  for  the  VOICE  scales. 

The  number  of  Black  students  who  participated  In  the  study  was  con- 
siderably less  than  planned,  but  was  sufficient  for  establishing 
national  norms  for  Black  males  and  females  In  grades  10,  11,  and  12. 
The  sample  sizes  for  the  other  groups  were  higher  than  anticipated, 
amounting  to  a sound  data  base  for  the  VOICE  norms. 

The  extent  of  spread  of  scores  on  any  scale  did  not  appear  to 
distinguish  between  groups  and  differences  In  standard  deviations  were 
not  consistent  with  respect  to  scale  or  group  (Tables  8 through  13). 
Every  set  of  comparison  groups  showed  statistically  significant  mean 
score  differences  on  one  scale  or  another.  Except  for  predictable 
male-female  differences  the  actual  differences  In  number  of  points 
were  usually  small.  It  Is  suggested  that  these  small  differences 
be  considered  in  noting  that  the  strongest  results  were: 

1.  Both  male  and  female  groups  In  the  Pacific  West  had  the 
lowest  mean  scores  of  any  region  on  most  of  the  VOICE 
scales. 

2.  Black  male  and  female  groups  tended  to  express  higher 
Interests  than  did  non-Blacks  on  at  least  eight  scales 
rather  consistently  across  regions  (Office  Administra- 
tion, Electronics,  Science,  Mathematics,  Teacher/ 

Counseling,  Craftsman,  Drafting,  Data  Processing), 
while  non-Blacks  showed  high  Interest  more  strongly  on 
only  two  (Outdoors  and  Agriculture). 

3.  Reported  vocational  Interest  on  virtually  all  of  the 
scales  tended  to  Increase  as  grade  level  Increased, 
except  that  scores  tended  to  stabilize  In  the  11th 
grade  for  female  groups. 
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The  Scales.  !f  degree  of  group  Interest  In  a vocation  is  implied 
by  the  position  of  the  mean  with  respect  to  the  midpoint  of  the  scale 
score  range,  the  vocational  scales  that  elicited  the  most  Interest  for 
males  were  Outdoors,  Mechanics,  and  Marksman.  These  were  the  ohly 
areas  In  which  means  were  higher  than  midpoints.  Using  this  criterion, 
the  scales  of  most  Interest  to  the  female  students  were  Outdoors, 
Audiographics,  and  Teacher/Counseling.  Means  were  at  the  midpoints 
for  the  female  group  for  Medical  Service  and  Agriculture. 

Use  of  Group  Norms.  The  normlng  and  standardization  of  the  VOICE 
scales  were  Intended  as  a field  study,  not  a test  of  an  hypothesis 
that  there  are  differences  of  vocational  Interest  between  regional 
groups  or  between  ethnic  groups.  The  apparent  differences  found  In 
the  samples  should  be  treated  with  caution  to  avoid  concluding  that 
true  differences  between  the  regional  or  ethnic  populations  exist. 

The  size  of  t capitalizes  on  sample  size,  which  was  high  In  this 
study  (Table  14).  It  Is  the  practical  utility  that  should  be  consid- 
ered. If  Black  male  students  differ  from  other  males  slightly  on 
nine  of  the  VOICE  scales,  should  guidance  counselors  use  separate 
norms  for  them?  What  Is  the  value  to  the  Black  student  of  knowing 
that,  with  a raw  score  of  17  on  Craftsman  (the  scale  showing  the 
highest  t between  Black  and  Other  Males),  he  is  at  the  96th  percentile 
on  Black  norms  and  at  the  99th  on  the  norms  for  Other  Males?  With 
respect  to  providing  a reference  work  for  counselors,  it  is  recom- 
mended that  national  male  and  female  VOICE  norms,  undifferentiated  as 
to  race,  be  provided  in  a manual.  For  the  sake  of  completeness,  an 
appendix  can  be  made  available  containing  differential  norms  (region 
and  race)  only  for  the  scales  that  distinguished  significantly  between 
groups . 

The  finding  that  Interest  on  most  scales  Increases  with  grade 
level  suggests  that  the  national  norms  should  be  based  on  the  Grade  12 
data,  or,  for  the  sake  of  sample  size,  that  the  Grade  10  data  be 
deleted  and  national  norms  be  recomputed  by  combining  the  data  for 
Grades  11  and  12. 


Practical  Considerations  for  Future  Studies 


Sampling  of  Schools.  Schools  should  be  overselected  to  compensate 
for  non-respondents  and  for  refusals.  In  planning  the  Initial  selec- 
tion number.  It  should  be  kept  In  mind  that  approximately  20  percent 
of  those  who  agree  to  participate  may  not  meet  the  romnltment,  as 
occurred  with  this  study.  Reasons  given  Included  severe  economic 
constraints,  particularly  In  the  Northeast;  changing  of  school  staff; 
unexpected  schedule  changes  due  to  weather  or  other  factors;  belated 
refusals  from  local  education  boards;  and  high  absentee  rates.  An 
overselection  factor  of  at  least  five  Is  recommended. 

VOICE  Administration  Time.  Only  250  of  the  400  items  on  the 
VOICE  questionnaire  appear  on  the  18  scales.  The  time  taken  to  complete 
the  400-Item  questionnaire  frequently  extended  to  one  and  a half  hours, 
particularly  In  areas  where  reading  aptitude  Is  low.  The  administra- 
tion time  was  a problem  not  only  because  of  the  constraints  of  class 
schedules  but  also  because  some  students  tended  to  become  bored  and 
impatient.  In  these  cases,  answer  sheets  were  frequently  defaced  by 
drawings  or  pithy  comments.  Since  only  250  Items  are  necessary  to 
compute  scale  score  values,  It  Is  recommended  that  the  remaining  150 
be  deleted.  If  only  to  save  testing  time. 
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